A Model of an Oscillatory Neural Network with Multilevel Neurons for Pattern Recognition and Computing

The current study uses a novel method of multilevel neurons and high order synchronization effects described by a family of special metrics, for pattern recognition in an oscillatory neural network (ONN). The output oscillator (neuron) of the network has multilevel variations in its synchronization value with the reference oscillator, and allows classification of an input pattern into a set of classes. The ONN model is implemented on thermally-coupled vanadium dioxide oscillators. The ONN is trained by the simulated annealing algorithm for selection of the network parameters. The results demonstrate that ONN is capable of classifying 512 visual patterns (as a cell array 3 * 3, distributed by symmetry into 102 classes) into a set of classes with a maximum number of elements up to fourteen. The classification capability of the network depends on the interior noise level and synchronization effectiveness parameter. The model allows for designing multilevel output cascades of neural networks with high net data throughput. The presented method can be applied in ONNs with various coupling mechanisms and oscillator topology.Comment: 26 pages, 24 figure

Method of increasing the information capacity of associative memory of oscillator neural networks using high-order synchronization effect

Computational modelling of two- and three-oscillator schemes with thermally coupled $VO_2$-switches is used to demonstrate a novel method of pattern storage and recognition in an impulse oscillator neural network (ONN) based on the high-order synchronization effect. The method ensures high information capacity of associative memory, i.e. a large number of synchronous states $N_s$. Each state in the system is characterized by the synchronization order determined as the ratio of harmonics number at the common synchronization frequency. The modelling demonstrates attainment of $N_s$ of several orders both for a three-oscillator scheme $N_s$~650 and for a two-oscillator scheme $N_s$~260. A number of regularities are obtained, in particular, an optimal strength of oscillator coupling is revealed when $N_s$ has a maximum. A general tendency toward information capacity decrease is shown when the coupling strength and switch inner noise amplitude increase. An algorithm of pattern storage and test vector recognition is suggested. It is also shown that the coordinate number in each vector should be one less than the switch number to reduce recognition ambiguity. The demonstrated method of associative memory realization is a general one and it may be applied in ONNs with various mechanisms and oscillator coupling topology.Comment: 18 pages, 8 figure

A Bio-Inspired Chaos Sensor Based on the Perceptron Neural Network: Concept and Application for Computational Neuro-science

The study presents a bio-inspired chaos sensor based on the perceptron neural network. After training, the sensor on perceptron, having 50 neurons in the hidden layer and 1 neuron at the output, approximates the fuzzy entropy of short time series with high accuracy with a determination coefficient R2 ~ 0.9. The Hindmarsh-Rose spike model was used to generate time series of spike intervals, and datasets for training and testing the perceptron. The selection of the hyperparameters of the perceptron model and the estimation of the sensor accuracy were performed using the K-block cross-validation method. Even for a hidden layer with 1 neuron, the model approximates the fuzzy entropy with good results and the metric R2 ~ 0.5-0.8. In a simplified model with 1 neuron and equal weights in the first layer, the principle of approximation is based on the linear transformation of the average value of the time series into the entropy value. The bio-inspired chaos sensor model based on an ensemble of neurons is able to dynamically track the chaotic behavior of a spiked biosystem and transmit this information to other parts of the bio-system for further processing. The study will be useful for specialists in the field of computational neuroscience.Comment: 12 pages, 22 figures, 4 table

IoT-Oriented Design of an Associative Memory Based on Impulsive Hopfield Neural Network with Rate Coding of LIF Oscillators

The smart devices in Internet of Things (IoT) need more effective data storage opportunities, as well as support for Artificial Intelligence (AI) methods such as neural networks (NNs). This study presents a design of new associative memory in the form of impulsive Hopfield network based on leaky integrated-and-fire (LIF) RC oscillators with frequency control and hybrid analog–digital coding. Two variants of the network schemes have been developed, where spiking frequencies of oscillators are controlled either by supply currents or by variable resistances. The principle of operation of impulsive networks based on these schemes is presented and the recognition dynamics using simple two-dimensional images in gray gradation as an example is analyzed. A fast digital recognition method is proposed that uses the thresholds of zero crossing of output voltages of neurons. The time scale of this method is compared with the execution time of some network algorithms on IoT devices for moderate data amounts. The proposed Hopfield algorithm uses rate coding to expand the capabilities of neuromorphic engineering, including the design of new hardware circuits of IoT

Switch Elements with S-Shaped Current-Voltage Characteristic in Models of Neural Oscillators

In this paper, we present circuit solutions based on a switch element with the S-type I–V characteristic implemented using the classic FitzHugh–Nagumo and FitzHugh–Rinzel models. Using the proposed simplified electrical circuits allows the modeling of the integrate-and-fire neuron and burst oscillation modes with the emulation of the mammalian cold receptor patterns. The circuits were studied using the experimental I–V characteristic of an NbO2 switch with a stable section of negative differential resistance (NDR) and a VO2 switch with an unstable NDR, considering the temperature dependences of the threshold characteristics. The results are relevant for modern neuroelectronics and have practical significance for the introduction of the neurodynamic models in circuit design and the brain–machine interface. The proposed systems of differential equations with the piecewise linear approximation of the S-type I–V characteristic may be of scientific interest for further analytical and numerical research and development of neural networks with artificial intelligence

Bifurcation and Entropy Analysis of a Chaotic Spike Oscillator Circuit Based on the S-Switch

This paper presents a model and experimental study of a chaotic spike oscillator based on a leaky integrate-and-fire (LIF) neuron, which has a switching element with an S-type current-voltage characteristic (S-switch). The oscillator generates spikes of the S-switch in the form of chaotic pulse position modulation driven by the feedback with rate coding instability of LIF neuron. The oscillator model with piecewise function of the S-switch has resistive feedback using a second order filter. The oscillator circuit is built on four operational amplifiers and two field-effect transistors (MOSFETs) that form an S-switch based on a Schmitt trigger, an active RC filter and a matching amplifier. We investigate the bifurcation diagrams of the model and the circuit and calculate the entropy of oscillations. For the analog circuit, the “regular oscillation-chaos” transition is analysed in a series of tests initiated by a step voltage in the matching amplifier. Entropy values are used to estimate the average time for the transition of oscillations to chaos and the degree of signal correlation of the transition mode of different tests. Study results can be applied in various reservoir computing applications, for example, in choosing and configuring the LogNNet network reservoir circuits